PD-03W179 



METHOD FOR ANALYZING OUTPUT DATA OF 
ARRAY SUBELEMENTS OF AN IMAGING SEGMENTED ARRAY 



Mary Morabito O'Neill 
Gregory K. Pierce 
William H. Wellman 



- 1 - 

METHOD FOR ANALYZING OUTPUT DATA OF 
ARRAY SUBELEMENTS OF AN IMAGING SEGMENTED ARRAY 

[0001] This invention relates generally to the analysis of the output data 

of an imaging segmented array and, more particularly, to the analysis of the output 
5 data of a segmented light-detector array. 

BACKGROUND OF THE INVENTION 

[0002] Tracking systems commonly determine the position of an object by 

analyzing its image with a segmented detector having a multiplicity of array 
subelements that are approximately equal in size and shape. Optical systems 

10 typically form an image on a spectrally selective semiconductor array of 
subelements, in either the visible, infrared, or ultraviolet spectral ranges. The high 
resolution of optical systems enables the precise setting of detector subelement 
size, shape, and placement. Most commonly, square detector subelements are 
used in such systems, although other symmetric shapes, such as mosaics of regular 

15 hexagons, have been used in detector arrays. Non-optical systems can use the 
same imaging principles. Radar systems form an image by antenna beam pattems, 
and the detector is a frequency-selective receiver. Acoustic systems form an 
image on a sound-selective sensor. 

[0003] In each case, the image is divided among multiple detector array 

20 subelements, either by simultaneously sensing on a fixed detector array, or by 
sequentially sensing as the scene is moved over the detector. This image motion 
can be imparted by physical motion of the scene, the entire sensor, the detector, 
the imaging means, or other sensor-intemal mechanism. The image division 
among multiple subelements also can be imparted with no physical motion, by 
25 electronic processing that subdivides a scene image, or by electronic scanning that 
moves sub-images across a large scene image. 

[0004] In one common approach, where the image is not much larger than 

a detector subelement, the location of an object is determined relative to the 
detector centerline by analyzing the difference in signal between adjacent 



-2- 



subelements. This can be done in one dimension, with two array subelements 
adjacent in a side-by-side relation. The "left-right" position is the simple 
difference of the signal from the "left" subelement minus the signal from the 
"right" subelement. Usually this difference signal is normalized by dividing by 
5 the sum of the "left" and "right" signals, in order to give a position indication that 
does not vary with signal strength. This same principle may be applied in two 
dimensions, using four detector subelements in a symmetrical quadrant array, with 
the subelements pair-wise differenced. For example, "up-down" signals are 
generated by the difference between the sums of the signals from the two "upper" 

10 subelements, minus the sum of the signals from the two "lower" subelements. 
Such techniques are common in monopulse radar sensors that are used for missile 
guidance and other applications. These techniques are also used in optical 
trackers and acoustic sensors. Such location signals are often used by a tracking 
mechanism, to set the aim point at this centerline location. 

1 5 [0005] In another common approach, where the image covers several array 

subelements, the center or centroid of the image is determined. This approach is 
most common in optical systems, which typically use large arrays of detector 
subelements to create a scene image. The location determination then is made by 
locating the center or centroid within this array. This approach determines the 

20 position over a wider range of displacements than is possible with only two or 
four detector subelements, yet maintains the same positional accuracy. 
[0006] The accuracy of the determination of the location of the feature is 

a crucial concem in such sensors. The spatial location of the image on the 
detector array may be translated geometrically into an angle of the feature relative 

25 to a reference axis of the sensor, such as the boresight of the platform that carries 
the sensor. 

[0007] An important unsolved problem is that there may be substantial 

positional ambiguity in determining the image location on the array of 
subelements, which translates into a substantial angular ambiguity in determining 
30 the location of the feature that produces the image. There is an ongoing need for 
an improved approach for segmented-array detectors to achieve increased 
accuracy in the determination of the location of the image of the feature without 
sacrificing sensitivity. The present invention fiilfiUs this need, and further 



-3- 



provides related advantages. 

SUMMARY OF THE INVENTION 

[0008] The present invention provides a method for analyzing the output 

signals of the subelements of the detector array that results in increased positional 
5 accuracy of the determination of the image location, without added hardware cost. 
The sensitivity of the detector array is not compromised. This approach may be 
used with imaging segmented-array sensors using any type of radiation, including 
light, acoustic, and radio frequency radiation. The present approach is compatible 
with other known sensor technologies such as the use of filters placed between the 
10 scene and the detector array, so that a wide range of spectral bands may be 
viewed. No changes to the optics system are required to achieve the improved 
accuracy determination. 

[0009] In accordance with the invention, a method for locating a position 

of a feature in a scene comprises the steps of forming an image of the feature 

15 using a segmented array having a plurality of array subelements, wherein each of 
the array subelements has an output signal, and cooperatively analyzing the output 
signals from at least two spatially adjacent array subelements. The cooperative 
analysis is performed to establish a data set reflective of an extent to which output 
signals responsive to the image of the feature are produced from exactly one or 

20 from more than one of the adjacent array subelements, and to reach a conclusion 
from the data set as to a location of the image of the feature on the segmented 
array. 

[0010] The step of forming may include the step of providing a sensor 

including an optics system that forms the image of the feature of the scene at an 

25 image surface, and the segmented array at the image surface upon which the 
image is formed. In one application of interest, the segmented array is a 
segmented light-detector array having a plurality of light-detector subelements. 
[0011] The sensor may be a one-dimensional segmented array formed of 

pairs of two adjacent array subelements, which is typically a part of a scanning 

30 sensor. The array subelements may be spatially overlapping or non-spatially 
overlapping. The step of cooperatively analyzing may include the steps of 



-4- 



determining whether output signals responsive to the image of the feature are 
produced by one or both of the two adjacent array subelements, and identifying 
the location of the image of the feature responsive to the step of determining 
whether output signals responsive to the feature are produced by one or both of 
5 the two adjacent array subelements. The step of cooperatively analyzing may 
instead include the steps of determining relative strengths of output signals 
responsive to the feature produced by the two adjacent array subelements, and 
identifying the location of the image of the feature responsive to the step of 
determining relative strengths of output signals responsive to the feature. That is, 
10 the cooperative analysis may be based on whether output signals are produced, or 
the relative strengths of such output signals. 

[0012] The sensor may be a two-dimensional segmented array, usually 

formed of a pattern of intersecting array subelements. ("Intersecting" array 
subelements are separate subelements that meet at an intersection line or an 

15 intersection point in the segmented array. In the cases of interest using square or 
rectangular array subelements, two, three, or four array subelements meet at 
intersection lines and points in the segmented array, depending upon whether the 
array subelements are staggered or not.) The step of cooperatively analyzing may 
include the steps of determining whether output signals responsive to the image 

20 of the feature are produced in single ones or combinations of the intersecting array 
subelements, and identifying the location of the image of the feature responsive 
to a distribution of the output signals from the step of determining whether output 
signals responsive to the image of the feature are produced in the intersecting 
array subelements. The step of cooperatively analyzing may instead include the 

25 steps of determining the relative strengths of the output signals responsive to the 
image of the feature that are produced in combinations of the intersecting array 
subelements, and identifying the location of the image of the feature responsive 
to the relative strengths of the output signals from the step of determining the 
relative strengths of the output signals responsive to the image of the feature that 

30 are produced in combinations of the intersecting array subelements. That is, as in 
the case of the one-dimensional segmented array, the cooperative analysis may be 
based on whether output signals are produced, or on the relative strengths of such 
output signals. In both the one-dimensional and two-dimensional cases. 
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"whether'' output signals are produced is really a subset of the "relative strengths" 
of the output signals, since relative strengths of 0 and 1 are the limits of the 
expression of "whether" output signals are produced. 

[0013] In the conventional approach, the location of the image of the 

5 feature is determined by analyzing the output signal of each array subelement on 
its own as to the magnitude of its output signal. This approach leads to significant 
positional ambiguity when the image overlies two or more of the array 
subelements, and therefore the energy of the image is divided between the two or 
more array subelements. The ambiguity arises because a weak signal from a 

10 particular subelement may be a result of either a partial overlying of a strong 
signal of the image, or a relatively full overlaying of a weak signal of the image. 
[0014] In the present approach, on the other hand, the output signals of 

combinations or sets of adjacent array subelements are analyzed together, 
reducing positional ambiguity for images that overlie two or more of the adjacent 

1 5 array subelements. 

[0015] Other features and advantages of the present invention will be 

apparent from the following more detailed description of the preferred 
embodiment, taken in conjunction with the accompanying drawings, which 
illustrate, by way of example, the principles of the invention. The scope of the 

20 invention is not, however, limited to this preferred embodiment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] Figure 1 is a schematic elevational view of a light sensor; 

[0017] Figure 2 is a schematic plan view of a non-overlapped one- 

dimensional segmented array of light-detector subelements; 
25 [0018] Figure 3 is a schematic plan view of an overlapped one-dimensional 

segmented array of light-detector subelements; 

[0019] Figure 4 is a schematic plan view of a non-staggered two- 

dimensional segmented array of light-detector subelements; 
[0020] Figure 5 is a schematic plan view of a staggered two-dimensional 

30 segmented array of light-detector subelements; 

[0021] Figure 6 is a block flow diagram of a method for practicing an 
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embodiment of the invention; 

[0022] Figure 7 is a schematic plan view of a non-overlapped one- 

dimensional segmented array of light-detector subelements similar to Figure 2, 
with indicated ranges relevant to the present analytical approach; 
5 [0023] Figure 8 is a schematic plan view of an overlapped one-dimensional 

segmented array of light-detector subelements similar to Figure 3, with indicated 
ranges relevant to the present analytical approach; 

[0024] Figure 9 is a schematic plan view of a non-staggered two- 

dimensional segmented array of light-detector subelements similar to Figure 4, 
10 with indicated ranges relevant to the present analytical approach; and 

[0025] Figure 10 is a schematic plan view of a staggered two-dimensional 

segmented array of light-detector subelements. 

DETAILED DESCRIPTION OF THE INVENTION 

[0026] Figure 1 depicts an imaging sensor 20, which in this case is a light- 

15 detecting sensor. The sensor includes an optics system 22, schematically 
indicated by a single lens element but which may include one or more lenses, 
mirrors, and other optical elements that form an image 24 of a feature 26 of a 
scene at an image surface 28. A segmented light-detector array 30 having a 
plurality of light-detector subelements 32 is positioned at the image surface 28. 
20 Each of the light-detector subelements 32 has an output signal 34. The present 
approach is applicable to the processing of the output signals 34 of such an 
imaging sensor 20 to form an image, for the case of the illustrated light sensor and 
also for other types of imaging sensors utilizing other types of energy, such as 
ultrasonic imaging sensors and radio-frequency imaging sensors. Standard forms 
25 of such imaging sensors are known in the art, with the exception of the 
modifications and improvements discussed herein. Light-imaging sensors are of 
the greatest current interest to the inventors, and will be used herein to illustrate 
the principles of the invention. 

[0027] Figures 2-5 illustrate some of the forms of the segmented light- 

30 detector array 30 and its light-detector subelements 32, in the view as seen looking 
from the feature 26 toward the image 24 in Figure 1 . Figures 2-3 depict one- 
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dimensional light-detector arrays 30 wherein the Hght-detector subelements 32 are 
arranged in a linear manner parallel to a longitudinal direction 36, but have a 
small width in a transverse direction 38 lying perpendicular to the longitudinal 
direction 36. The light-detector subelements 32 are depicted as rectangular in 
5 shape, but they may have other shapes. The light-detector subelements 32 of 
Figure 2 are fiilly one-dimensional, whereas the light-detector subelements 32 of 
Figure 3 are arranged in an overlapping form that gives the light-detector array 30 
a slight width in the transverse direction 38 (but is within the term "one- 
dimensional" as used herein). One-dimensional light-detector arrays 30 are 
10 usually scanned past a two-dimensional scene to produce a two-dimensional 
image of the full scene. 

[0028] Figures 4-5 depict portions of larger two-dimensional light-detector 

arrays 30 wherein the array of light-detector subelements 32 extends in both the 
longitudinal direction 36 and the transverse direction 38. The light-detector 

15 subelements 32 of Figure 4 are depicted as square in shape (a special case of the 
rectangular shape), and the light-detector subelements 32 of Figure 5 are depicted 
as rectangular in shape (but could be square in shape). The non-staggered light- 
detector subelements 32 of Figure 4 have an intersection point 40 where four of 
the light-detector subelements 32 meet, while pairs of light-detector subelements 

20 32 meet along intersection lines 42. The staggered light-detector subelements 32 
of Figure 5 have no intersection points where four light-detector subelements 32 
meet, although there are intersection points 44 where exactly three of the light- 
detector subelements 32 meet. 

[0029] The light-detector arrays 30 of Figures 2-5 are presented as 

25 examples of one-dimensional and two-dimensional arrays. The present approach 
is applicable to these illustrated arrays, as well as other forms of one-dimensional 
and two-dimensional arrays. 

[0030] Figure 6 depicts a method for locating a position of a feature in a 

scene. An image of the feature is formed, step 50, using a segmented array having 
30 a plurality of array subelements. Preferably but not necessarily, an imaging sensor 
20 such as that described in relation to Figures 1 -5 is used to form the image 24 
in step 50. The output signals from at least two spatially adjacent array 
subelements are cooperatively analyzed, step 52. The purpose of the cooperative 
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analysis 52 is to establish a data set reflective of an extent to which output signals 
responsive to the image of the feature are produced from exactly one or from more 
than one of the adjacent array subelements, and to reach a conclusion from the 
data set as to a location of the image 24 of the feature on the segmented array 30. 
5 To implement step 52, the output signals 34 for adjacent array subelements 32 are 
first determined, step 54, and then the location of the image 24 is identified, step 
56. 

[0031] Figures 7-9 illustrate how these steps 54 and 56 are performed to 

achieve the cooperative analysis for three cases corresponding to Figures 2-4. 

10 Other cases are analyzed in a comparable manner. In each case, a blur circle 60 
with a blur diameter is shown. If the imaged feature 26 is a point, its image 24 is 
projected as the blur circle 60 at the image surface 28 due to diffraction and 
aberration effects of the optics system 22. The diameter of the blur-circle image 
at the image surface of the point at infinity is termed the "blur diameter" BD, 

15 which is a characteristic of the optics system 22. 

[0032] Figure 7 illustrates a non-overlapping segmented light-detector 

array 30 that is scanned in the transverse direction 38. The segmented light- 
detector array 30 has three light-detector subelements 32, indicated as A, B, and 
C. In a conventional analysis approach, the output of each light-detector 

20 subelement 32 is individually analyzed. If there is an output from light-detector 
subelement B, for example, it is judged that the image is within light-detector 
subelement B. That is, the image is within the range 62. With the present 
approach, a data set is determined as to whether there is an output signal from 
only light-detector subelement B, or whether there is simultaneously an output 

25 signal from both light-detector subelement B and light-detector subelement A, or 
whether there is simultaneously an output signal from both light-detector 
subelement B and light-detector subelement C. If, for example, there is an output 
signal from only light-detector subelement B, then it may be concluded that the 
image 24 is within the range 64, a smaller range than the range 62. If there is an 

30 output signal from both light-detector subelement B and light-detector subelement 
A, then it may be concluded that the image 24 is within the range 66, which is two 
blur diameters BD wide. If there is an output signal from both light-detector 
subelement B and light-detector subelement C, then it may be concluded that the 
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image 24 is within the range 67, which is two blur diameters BD wide. The result 
of this analysis is that the location of the image may be determined more 
accurately in relation to the light-detector subelements than in the conventional 
approach. There are three analyzable ranges for each Ught-detector subelement, 
5 one in the center and one at each end. 

[0033] Even more striking improvements in positional accuracy may be 

obtained from an overlapping configuration of the light-detector subelements D, 
E, and F, as shown in Figure 8. In this illustrated configuration, there is a 1/3 
longitudinal overlap in each pair of the light-detector subelements DE and EF. If 

10 there is a full-strength output signal from light-detector subelement E only as the 
segmented light-detector array 30 is scanned in the transverse direction 38, the 
image must be within the range 68. If there is a ftiU-strength output signal from 
both light-detector subelements D and E, the image must be within the range 70. 
If there is a fiiU-strength output signal from both light-detector subelements E and 

15 F, the image must be within the range 72. Further information on the location of 
the image may be gained by considering fractional output signals. Thus, for 
example, if a partial-strength output signal is obtained from light-detector 
subelement D and a full-strength output signal is obtained from light-detector 
subelement E, the image must be within the range 74. If a partial-strength output 

20 signal is obtained from light-detector subelement F and a full-strength output 
signal is obtained from light-detector subelement E, the image must be within the 
range 76. By configuring the overlapping light-detector subelements D, E, and 
F so that the ranges 68, 70, 72, 74, and 76 are the same lengths, the position of the 
image may be determined with the greatest accuracy. 

25 [0034] Yet further accuracy of the image location may be achieved by 

evaluating proportional output signals in the approaches of Figures 7 and 8, as to 
the ranges where the image falls within two of the light-detector subelements. For 
example, in the non-overlapping case of Figure 7, if there is a 75 percent output 
from light-detector subelement A and a 25 percent output from light-detector 

30 subelement B, the image must lie within the range 66 but more within light- 
detector subelement A than light-detector subelement B. The distinction is that 
in the embodiment of the analysis approach of the present invention discussed in 
preceding paragraphs, the determination is whether output signals responsive to 
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the image of the feature are produced in single ones or combinations of the 
intersecting array subelements. In the embodiment of the analysis approach of the 
present invention discussed in this paragraph, the determination is the relative 
strengths of the output signals responsive to the image of the feature that are 
5 produced in combinations of the intersecting array subelements. The same 
analysis may be applied to the overlapping light-detector subelements of Figure 
8. 

[0035] A visual comparison of the ranges illustrated in Figures 7 and 8 

gives a graphic indication of the present improvement. In the conventional 

10 approach as illustrated in Figure 7, the image location may be determined only 
within the range 62. In the present approach as applied to the non-overlapping 
light-detector subelements of Figure 7, the determination of positional accuracy 
is improved so that the image by identifying its location as lying within the ranges 
64, 66, or 67, But the greatest improvement in accuracy of the determination of 

15 the image location is achieved with the overlapping light-detector subelements of 
Figure 8, wherein the image may be located as lying within the ranges 68, 70, 72, 
74, or 76, each of which is much shorter than the conventional accuracy range 62 
of Figure 7. 

[0036] The present approach is also applicable to the two-dimensional non- 

20 staggered staring array of Figure 9, which shows four light-detector subelements 
G, H, I, and J of a much-larger square light-detector array 30. The light-detector 
subelements G, H, I, and J are each square in shape, and the four light-detector 
subelements meet at a common point. This pattern is repeated throughout the 
array. In the conventional approach, the output signals of light-detector 
25 subelements G, H, I, and J are tested individually, so that the location of the image 
may be determined only with the accuracy of the length LgOf the side of each of 
light-detector subelements G, H, I, and J. With the present approach, on the other 
hand, the output signals of the light-detector subelements G, H, I, and J are 
evaluated in combinations. For example, if there is an output signal only from 
30 light-detector subelement G, then the image may be only within the range 80 at 
the center of light-detector subelement G. If there is an output signal from light- 
detector subelement G and also from light-detector subelement H (and no other 
light-detector subelements), then the image may be only within the range 82. If 
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there is an output signal from light-detector subelement G and also from light- 
detector subelement H and also from light-detector subelement I and also from 
light-detector subelement J, then the image may be only within the range 84. A 
similar analysis applies for output signals from other light-detector subelements 
5 that intersect with light-detector subelement G (and from all other light-detector 
subelements in the segmented light-detector array 30). The relative-strength 
approach discussed above may also be applied to the two-dimensional array. 
Thus, for example, if light-detector subelement G has a 75 percent output signal 
and light-detector subelement H has a 25 percent output signal (and there are zero 

10 output signals from the other light-detector subelements), the image is within the 
region 82 but proportionally more in light-detector subelement G than in light- 
detector subelement H. If the regions 80, 82, and 84 are dimensioned equally with 
sides L„ a comparison of Lq and L, shows that the determination of position of the 
image is significantly more accurate with the present approach than with the 

1 5 conventional approach. 

[0037] The present approach is also applicable to a two-dimensional 

staggered array as shown in Figure 10, using the same principles as those 
discussed in relation to Figure 9. In this case, a maximum of three subelements 
meet at an intersection point, and two subelements meet along intersection lines. 

20 [0038] The discussion has assumed that the blur circle 60 has a constant 

intensity across its area, which is typically a reasonably good assumption. If that 
assumption is not met and the blur circle 60 as a position-dependent intensity, this 
variation in intensity may be taken into account in the computer implementation 
of the analytical approach discussed herein. 

25 [0039] The present analytical approach may be applied to conventional 

types of segmented light-detector arrays, such as illustrated in Figures 2 and 4, to 
produce better accuracy in the determination of the location of an image that falls 
upon the segmented light-detector array. In these cases, the conventional 
configuration of the segmented light-detector array is retained, and only analysis 

30 of the output signals of the light-detector subelements is altered according to the 
present approach. The present approach may also be used in conjunction with 
new configurations of the segmented light-detector arrays designed in conjunction 
with the present approach, such as illustrated in Figures 3, 5, and 10, to produce 
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even greater accuracy in the determination of image location than is possible with 
the use of the present approach as applied to the conventional segmented light- 
detector arrays of Figures 2 and 4. In all cases, the present approach is 
implemented in the form of a logic analysis applied to the output signals of the 
5 light-detector subelements. 

[0040] Although a particular embodiment of the invention has been 

described in detail for purposes of illustration, various modifications and 
enhancements may be made without departing from the spirit and scope of the 
invention. Accordingly, the invention is not to be limited except as by the 
1 0 appended claims. 



